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1. Introduction 


Energy including renewable energy and geologic storages is an 
essential input to all forms of economic and social activities as 
shown in Fig. 1. Energy system plays an important role in the 
economic and social development of a country and the living 
quality of people [1,2]. The major energy demand of fossil fuels has 
major consequences around the world. A main environmental 
problem is the emission of toxic chemical pollutants, greenhouse 
gases like CO, and other air pollutants [3,4]. These cause climate 
change and environmental pollution of air, land and water, which 
has a negative impact on the health and the living quality of 
humans [5]. Contrarily, global environmental issues could 
significantly affect patterns of energy use around the world [6]. 
Some new governmental policies have been adopted to encourage 
the introduction of energy efficiency measures, the technical 
changes, and the renewable and sustainable energy [3,7,8]. 
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The sustainable development has been the subject of wide- 
ranging discussion and debate within government, non-govern- 
ment and academic circles, being a major focus of national and 
international economic, social and environmental agendas [3,4,6- 
18]. Sustainable development means the satisfaction of present 
needs without compromising the ability of future generations to 
meet their own needs [19]. Sustainability can be seen as the final 
goal: a balance of social and economic activities and the 
environment [9]. A sustainable energy sector has a balance of 
energy production and consumption and has no, or minimal, 
negative impact on the environment (within the environmental 
tolerance limits), but gives the opportunity for a country to employ 
its social and economic activities. 

The rational decision-making (DM) in energy supply system 
options, planning, management and economy is helpful to the 
sustainable development. However, the complex interactions 
shown in Fig. 1 make DM more difficult. Sustainable energy 
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Fig. 1. The complex interactions of energy system. 
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decision-making using multi-criteria decision analysis (MCDA) 
just provides a method to eliminate the difficulty and it has 
attracted the attention of decision makers for a long time. MCDA is 
a form of integrated sustainability evaluation. It is an operational 
evaluation and decision support approach that is suitable for 
addressing complex problems featuring high uncertainty, con- 
flicting objectives, different forms of data and information, multi 
interests and perspectives, and the accounting for complex and 
evolving biophysical and socio-economic systems. The methods 
can provide solutions to increase complex energy management 
problems. Traditional single criteria approach is normally aimed at 
identifying the most efficient options at a low cost. Growing 
environmental awareness in the 1980s has slightly modified the 
single criteria decision framework. Nowadays, the focus on global 
environmental protection drives MCDA aid in energy systems. The 
MCDA methods have been widely applied to social, economic, 
agricultural, industrial, ecological and biological systems in 
addition to energy systems [20-27]. Compared to single criteria 


Establish 


decision goals 


Formulation of 
alternatives 


Identification 
of criteria 


Methods of 
selection criteria 
Assigning the 
criteria scores 


Normalization 


Determination of subjective 
weights of criteria 


Checking the concordance 
of criteria values 


Increasing a 
number of 
experts 


Concordance 
index sufficiently high? 


Determination of integrated 
weights of criteria 


MCDA Determination of preference 
Methods orders of alternatives 
Preference orders of 
alternatives are the same? 
yes 


Aggregation of 
preference orders 


Determination of 
objective weights 


General conclusions 


approach, the distinctive advantage of MCDA methods is to employ 
multi-criteria or attributes to obtain an integrated DM result. 

Generally, the MCDA problem for sustainable energy DM 
involves m alternatives evaluated on n criteria. The grouped 
decision matrix can be expressed as follows: 


criteria C, C, = C, 
(weights w w, = w) 
alternatives 
A Xi M2 Xin (1) 
X= A, Xal X22 Xn 
A. Xml x, 


‘m2 Xin mxn 


where x; is the performance of j-th criteria of i-th alternative, wj is 
the weight of criteria j, n is the number of criteria and m is the 
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Fig. 2. MCDA process in sustainable energy decision-making. 
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number of alternatives (these nomenclatures are just the same in 
this article). 

It can be found that the DM problem involves alternatives, 
criteria, criteria weights and the evaluating result from Eq. (1). The 
corresponding DM process can be formed to Fig. 2 [28,29]. It 
usually includes four main stages: alternatives’ formulation and 
criteria selection, criteria weighting, evaluation, and final treat- 
ment and aggregation. The preliminary step in MCDA is to 
formulate the alternatives for sustainable energy DM problem 
from a set of selected criteria and to normalize the original data of 
criteria. Secondly, criteria weights are determined to show the 
relative importance of criteria in MCDA. Then, the acceptable 
alternatives are ranked by MCDA methods with criteria weights. 
Finally, the alternatives’ ranking is ordered. If all alternatives’ 
ranking orders in different MCDA methods are just the same, the 
DM process is ended. Otherwise, the ranking results are aggregated 
again and the best scheme is selected. The four main sections in 
MCDA are presented and reviewed in Sections 2-5 respectively. 


2. Criteria selection 
2.1. Literature review on criteria in energy DM 


The energy issues applying MCDA includes energy planning and 
selection [11-13,30-47], energy resource allocation [48-54], 
energy exploitation [55,56], energy policy [57-59], building energy 
management [60-67], transportation energy systems [68,69] and 
others [70-75]. The reviewed literatures covered are both 
theoretical/conceptual and empirical. This article mainly reviews 
the MCDA methods for the selection of the energy supply systems. 
The reviewed articles have different energy supply systems, such 
as combined heating and power (CHP) or combined cooling 
heating and power (CCHP) systems [29,76-78], renewable energy 
systems [35,39], and different focus such as technological, 
economic and sustainability evaluation, objective and subjective 


Table 1 
The typical evaluation criteria of energy supply systems. 
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comparison, the impact on the living standard and the sensitivity 
analysis of power plants, etc. [43,79-81]. 

Measuring sustainability of the energy supply systems is a 
major issue as well as a driving force of the discussion on 
sustainability development. Developing evaluation criteria and 
methods that reliably measure sustainability is a prerequisite for 
selecting the best alternative, identifying non-sustainable energy 
supply system, informing design-makers of the integrated 
performances of the alternatives and monitoring impacts on the 
social environment. The multiplicity of criteria and measuring 
tools being developed in this fast-growing field shows the 
importance of the conceptual and methodological work in this 
area. The development and selection of criteria require parameters 
related to the reliability, appropriateness, practicality and limita- 
tions of measurement. The used criteria to evaluate the energy 
supply systems in the literatures mainly divide to four aspects: 
technical, economic, environmental and social criteria, which are 
summarized in Table 1. 


2.1.1. Technical criteria 


2.1.1.1. Efficiency. Efficiency refers to how much useful energy we 
can get from an energy source. The efficiency coefficient is the ratio 
of the output energy to the input energy, which is used to evaluate 
energy systems. Energy efficiency is said to be one of the “twin 
pillars” of a sustainable energy policy [93]. It has been proved that 
efficiency improvement that is consistent with high plant 
reliability and low-cost of products is economically beneficial 
[94]. Efficient energy use is essential to slowing the energy demand 
growth. It is the most used technical criteria to evaluate energy 
systems [11,13,30,35-44,77,87]. 


2.1.1.2. Exergy efficiency. Exergy efficiency (also known as the 
second-law efficiency or rational efficiency) computes the 
efficiency of a process taking the second law of thermodynamics 


Aspects Criteria Literatures Total number 
Technical Efficiency [11,13,30,35-44,77,87] 15 
Exergy efficiency [29,44,76] 3 
Primary energy ratio [29,45,76,82] 4 
Safety [29,39-42,45,76,83,86] 9 
Reliability [39-44,80,81,84] 9 
Maturity [29,82,84] 3 
Others [13,29,40,41,43,83-85] - 
Economic Investment cost [11,13,29,30,35-45,74,76-78,83-87,92] 24 
Operation and maintenance cost [30,39-44,74,76,84,85,87,92] 13 
Fuel cost [11,38,40-43,77,78,87] 9 
Electric cost [30,35-37,77,83,87] 
Net present value (NPV) [29,45,88-90] 5 
Payback period [13,29,45,88] 4 
Service life [30,36,76,85] 4 
Equivalent annual cost (EAC) [29,45,88,91] 4 
Others [11,39-42,44] - 
Environmental NO, emission [11,29,36-38,45,76,79-81,83,92] 12 
CO, emission [11,29,30,35-38,45,76-85,87,88,92] 21 
CO emission [29,45,76] 3 
SO2 emission [11,38,74,78-81,83] 8 
Particles emission [78-82] 5) 
Non-methane volatile organic compounds (NMVOCs) [79-81] 3 
Land use [29,35,36,76,77,80-82,86,87] 10 
Noise [29,45,76,84-86] 6 
Others [13,44,74,84,85,90,91] - 
Social Social acceptability [78,80,81,84] 4 
Job creation [13,36,38,80-82,86,89,90] 9 
Social benefits [13,39-42] 5 


Others 


[11,29,40-42,45,76,78,80,82] 
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into account. Energy changes from one form to another during a 
process. In contrast, exergy accounts for the irreversibility of a 
process due to increases in entropy. Exergy is always destroyed 
when a process involves a temperature change. Exergy is the 
energy that is available to be used. Exergy analysis is performed in 
the field of industrial ecology to use energy more efficiently, which 
was first coined by Rant in 1956 [95]. The CHP (CCHP) systems in 
the literatures were evaluated in these criteria [29,44,76]. 


2.1.1.3. Primary energy ratio (PER). PER is defined as the ratio of 
consumption primary energy to the users’ demand energy. 
Similarly primary energy saving is also a criteria that provides 
an estimation of the amount of primary energy that a given action 
allows to save. Primary energy saving can be assessed as the annual 
saved energy, which derives from fossil fuels. Such a saving can be 
estimated by means of: (1) technologies of conversion which use 
renewable energy sources or (2) reduction of final energy 
consumptions, under the same operating conditions. PER was 
employed to evaluate CCHP systems in [29,45,76] and primary 
energy saving was adopted to show the performances of renewable 
energy technologies [82] directly. Also, savings of finite energy 
sources were used [84]. 


2.1.1.4. Safety. Continuous changes in technology, environmental 
regulation and public safety concerns make the analysis of 
complex safety-critical of energy systems more and more 
demanding. Safety of energy systems is vital to society, national 
development and people’s life. The basic safety of workers on the 
site of energy project is guaranteed first. Safety is often seen as one 
of a group of related disciplines: quality, reliability, availability, 
maintainability and safety. The criteria are specifically defined 
when sustainable energy DM. Safety can be a technical evaluation 
criteria of applied technology and also a social criteria to show 
their effects of energy systems to society and people, etc. [29,39- 
42,45,76,83,86]. 


2.1.1.5. Reliability. Reliability of energy systems may be defined to 
the capacity of a device or system to perform as designed; the 
resistance to failure of a device or system; the ability of a device or 
system to perform a required function under stated conditions for 
a specified period of time; or the ability of something to “fail well” 
(fail without catastrophic consequences). Reliability has always 
been a concern in the energy sector. Some factors and events are 
heightening concern about energy reliability, such as political 
tensions, high profile terrorist activity, and massive blackouts [96- 
98]. The quality of the equipment, its maintenance, the type of fuel, 
the design of the energy system and how it is operated play a great 
role in its reliability. Reliability of energy systems is one among the 
essential criteria for their evaluations [39-44,80,81,84]. It can be 
expressed in a qualitative scale or a number, such as realization 
time in [84]. 


2.1.1.6. Maturity. Technical maturity is a criteria to evaluate the 
applied technology of energy systems [29,82,84]. Measuring the 
degree of maturity of the technology can refer how widespread the 
technology is at both national and international level. In detail, the 
following stages can be considered: (1) technologies that are only 
tested in laboratory; (2) technologies that are only performed in 
pilot plants, where the demonstrative goal is linked to the 
experimental one, referring to the operating and technical 
conditions; (3) technologies that could be still improved; and 
(4) consolidated technologies, which are close to reaching the 
theoretical limits of efficiency. 

Additionally, there are some particular criteria reflecting the 
technology of energy systems or equipments. The capacity of a 
power plant (it is defined to the amount of electricity that it 


produces over a period, divided by the amount of electricity it 
could have produced if it had run at full power over that period) 
was selected to evaluate its ability [43,83-85]. Availability of fuel 
was applied to [40,41] evaluate fossil fuel, solar energy, wind 
energy, hydro-electric and nuclear power plants. Also the ability to 
respond to peak load was employed to assess alternative scenarios 
for the power generation sector in Greece [83]. Regulation and 
control properties were used to reflect its technical performance 
[29] and knowledge of the innovative technology was employed to 
show its development [13]. The reserves-to-production ratio 
calculates the availability (in years) of a certain type of fuel 
according to current consumption and the annual consumption 
increase/decrease the rate of each non-renewable energy source 
for electric power generation [43]. 


2.1.2. Economic criteria 


2.1.2.1. Investment cost. Investment cost comprises of all costs 
relating to: the purchase of mechanical equipment, technological 
installations, construction of roads and connections to the national 
grid, engineering services, drilling and other incidental construc- 
tion work. Labor costs or costs for the equipment maintenance are 
not included in investment costs. Nuclear and coal-fired units are 
characterized by high investment costs and low operating costs 
while gas-fired generation is characterized by lower capital costs 
and higher operating costs. The investors must consider the 
investment costs and the benefit. Investment cost is the most used 
economic criteria to evaluate energy systems [11,13,29,30,35- 
45,74,76-78,83-87,92]. 


2.1.2.2. Operation and maintenance cost. Operation and mainte- 
nance costs consist of two parts. One is the operation cost that 
includes employees’ wages, and the funds spent for the energy, the 
products and services for the energy system operation. Another is 
the maintenance cost that aims to prolong energy system life and 
avoid failures that may lead to its operation suspension. The funds 
spent for maintenance are less than the financial damage obtained 
from an energy system failure and increase the credibility and 
confidence index of the energy system. The operation and 
maintenance costs are also divided into two subcategories: fixed 
and variable costs. Operation and maintenance cost is another 
most used economic criteria [30,39-44,74,76,84-86,92]. 


2.1.2.3. Fuel cost. Fuel cost refers to the fund spent for the 
provision of raw material necessary (i.e. uranium for nuclear 
power plants) for energy supply system operation. Fuel costs may 
include extraction or mining, transportation and possible fuel 
processing to be used in a power plant. Fuel costs may vary 
considerably in different time periods and areas as a result of 
several reasons, including demand, production and policy matters. 
The fuel is the essential input in energy system as shown in Fig. 1. 
Some researchers adopted fuel cost to evaluations [11,38,40- 
43,77,78,87]. Especially, it is notable that the fuel cost excludes 
from operation cost when fuel cost and operation and maintenance 
cost are both selected to evaluations. 


2.1.2.4, Electric cost. Electric cost, which is the product cost of 
power plant, was seen as a criteria to evaluate its economic 
performance from the viewpoint of consumers [30,35- 
37,77,83,87]. Governments, investors, producers and consumers 
have different expectation on the electric cost. It is necessary to 
evaluate the electric cost of different energy systems rationally. 


2.1.2.5. Net present value (NPV). NPV, also called as net present 
worth (NPW), is defined as the total present value of a time series 
of cash flows. It is a standard method for using the time value of 
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money to appraise long-term energy projects. Used for capital 
budgeting, and widely throughout economics, it measures the 
excess or shortfall of cash flows, in present value terms, once 
financing charges are met. NPV is often used to assess its feasibility 
of an energy project by investor. It is also necessarily considered in 
early stage of energy DM [29,45,88-90]. 


2.1.2.6. Payback period. Payback period of an energy project refers 
to the period of time required for the return on an investment to 
“repay” the sum of the original investment. It intuitively measures 
how long something takes to “pay for itself’; shorter payback 
periods are obviously preferable to longer payback periods to 
investor [13,29,45,88]. Although primarily a financial term, the 
concept of a payback period is occasionally extended to energy 
payback period (the period of time over which the energy savings 
of a project equal the amount of energy expended since project 
inception). 


2.1.2.7. Service life. An energy system’s service life is its expected 
lifetime, or the acceptable period of use in service. Generally, the 
energy system tire’s life follows the bathtub curve, to boot. After 
installation, there is a not-small probability of failure. Then, the tire 
will perform, given no defect-introducing event such as encoun- 
tering a road hazard (a nail or a pothole), for a long duration 
relative to its expected service life. After a period, the failure 
probability will rise again. Contrarily to payback period, longer 
service life is preferable to investor and it was employed to select 
the best scheme from energy system alternatives [30,36,76,85]. 


2.1.2.8. Equivalent annual cost (EAC). Equivalent annual cost of 
energy project is the cost per year of owning and operating an asset 
over its entire lifespan. EAC is often used as a decision-making tool 
in capital budgeting when comparing investment projects of 
unequal lifespan. EAC is calculated by dividing the NPV of an 
energy project by the present value of an annuity factor. Some 
works employed EAC as an evaluation criteria [29,45,88,91]. 

Expect these criteria, the special criteria were applied to MCDA. 
In some literatures, there were not specific environmental criteria 
to be used while the definite cost criteria were converted due to the 
environmental protection, such as CO, emission avoided [44] and 
environmental constraints cost [39-42]. 


2.1.3. Environmental criteria 


2.1.3.1. NOx emission. NOx is a generic term for mono-nitrogen 
oxides (NO and NO2). NO, comprise a group of molecules that can 
contribute to local air pollution, acid deposition and global climate 
change. NO, also readily reacts with ammonia, moisture, volatile 
organic compounds, common organic chemicals, and even ozone, 
to form a wide variety of toxic products which may damage the 
health of people and cause biological mutations. Consequently, 
they have a direct impact on the health of the community and an 
indirect impact on the social state of the community. NO, is 
produced during the combustion of fossil fuels and biomass, 
especially combustion at high temperatures. The NO, emission of 
energy system is popularly selected to evaluate its performances 
[11,29,36-38,45,76,79-81,83,92]. 


2.1.3.2. CO emission. CO, is a colorless, odorless and tasteless gas 
that is about one and a half times as dense as air under ordinary 
conditions of temperature and pressure. It was reported that CO3 
contributes 9-26% to the greenhouse effect [99]. CO2 is mainly 
released through the combustion of coal/lignite, oil and natural gas 
in energy systems. The disafforestation in the world lessen the 
removal of atmospheric CO2 by photosynthesis and also con- 
tributes to the greenhouse effect. Different energy systems have 


different CO2 emissions. For example, new technology combining 
cycles burning natural gas can save practically 33% of CO, 
emissions with regard to conventional cycles. CO3 leads to the 
global warming, which is focused by many governments, 
academies, and researchers. Naturally, CO2 emission of energy 
system is certainly a criteria to evaluate its sustainability 
[11,29,30,35-38,45,76-85,87,88,92]. 


2.1.3.3. CO emission. CO is produced from the partial combustion 
of carbon-containing compounds, notably in internal-combustion 
engines. Through natural processes in the atmosphere, it is 
eventually oxidized to carbon dioxide. Carbon monoxide has an 
atmospheric lifetime of only a few months [51] and as a 
consequence is spatially more variable than longer-lived gases. 
Likewise, anthropogenic CO from automobile and industrial 
emissions may contribute to the greenhouse effect and global 
warming. In literatures [29,45,76] CO emission was selected to 
characterize the performances of the energy systems. 


2.1.3.4. SO2 emission. SO is another harmful gaseous emission of 
coal/lignite, oil and combined cycle natural gas power plants. 
Further oxidation of SO2 forms H2SO, and thus acid rain [100], 
which is one of the causes for concern over the environmental 
impact of the use of these fuels as power sources. SO, is also 
associated with increased respiratory symptoms and disease, 
difficulty in breathing, and premature death. SO, can be chemically 
bound in flue gas desulfurization and the U.S. has witnessed a 33 
percent decrease in emissions between 1983 and 2002. However, 
the cost is considerable. Consequently the environment-friendly 
energy systems need higher operation costs necessarily. SO2 
emission can be selected to evaluate its contribution to environ- 
ment [11,38,74,78-81,83]. 


2.1.3.5. Particles emission. Particles emissions to the atmosphere 
are also one of the main environmental problems of the energy 
industries. These emissions are mainly released by coal/lignite and 
oil as well as biomass and photovoltaic power plants (during their 
cell construction). Fine particles formed in the atmosphere by the 
conversion of SO2 and NO, emissions scatter light and create hazy 
conditions, decreasing visibility and contributing to regional haze. 
Particles emission is also a worst type of emission for human 
health. The risk for human health depends on size, distribution, 
microstructure and chemical composition of particulate released 
into the atmosphere [80]. The particle size and type, etc, depends 
on the fuel of energy systems [101-103] so that some energy 
systems were evaluated in the criteria, particles emission [78-82]. 


2.1.3.6. Non-methane volatile organic compounds (NMVOCs). NM- 
VOC is a generic term for a large variety of chemically different 
compounds, like for example, benzene, ethanol, formaldehyde, 
cyclohexane, or acetone. Essentially, NMVOCs are identical to 
volatile organic compounds (VOCs), but with methane excluded. 
Sometimes NMVOC is also used as a sum parameter for emissions, 
where all NMVOC emissions are added up per weight into one 
figure. In the absence of more detailed data, this can be a very 
coarse parameter for pollution, e.g. for summer smog or indoor air 
pollution. Chatzimouratidis and Pilavachi selected NMVOCs to 
evaluate the power plants [43,79-81]. 


2.1.3.7. Land use. Energy system occupies some land. The land 
required by each plant is a matter of great concern for their 
evaluation [29,35,36,76,77,80-82,86,87]. The environment and 
landscape are affected directly by the land occupied by energy 
systems. Land use can also be a social criteria to evaluate the 
energy system. It represents one of the most critical factors for the 
intervention site, especially where the human activities are 
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relevant factors of environmental pressure [82]. Quality of people’s 
life is affected by energy systems as it could have been used for the 
creation of parks and recreation centers. The excavations, tunnels 
and other work necessary for energy systems operation destabilize 
the flora, the fauna and the ecosystem in general. Different energy 
systems occupy different land while the products are same. 
Particularly energy supply systems with biomass and biofuels 
require the large amount of land. Land use is necessarily 
considered to energy DM. 


2.1.3.8. Noise. Noise pollution from energy systems is displeasing 
machine-created sound that disrupts the activity or balance of 
human or animal life. It not only leads to the environmental effects, 
but also damage physiological and psychological health of human. 
Especially, chronic exposure to noise in working area of energy 
plants may cause noise-induced hearing loss. Noise can be an 
environmental criteria or social criteria to evaluate energy systems 
[29,45,76,84-86]. 

Additionally, some particular, pertinent and distinctiveness 
criteria reflecting the energy systems’ contributions to environ- 
ment were used. For instance, depletion of abiotic resources 
human toxicity, ecotoxicity, photo-oxidant formation and eutro- 
phication were used for natural gas energy solutions evaluation 
[44]. Visual impact reflects the visual nuisance that may be created 
by the development of an energy project in a specific area and it 
was used for evaluating the various wind energy plant alternatives 
proposed [84]. 

Except for these idiographic criteria, there are some recapitu- 
lative criteria in the sustainable energy decision-making, such as 
effects on natural environment [13,74,85,90], climate change 
[13,44,86,91] and acidification [44,91]. These criteria do not 
characterize the performances or contributions in only numerical 
data or aspect. For example, Both NO, emission and SO, emission 
contribute acid rain while acidification including the two criteria is 
used to evaluate energy systems. 


2.1.4. Social criteria 

Social aspects were definitely the most important criteria for 
people’s acceptance of energy systems during the past decades. 
Table 4 summarizes the key social criteria of energy supply 
systems in the literature. 


2.1.4.1. Social acceptability. Social acceptability expresses the 
overview of opinions related to the energy systems by the local 
population regarding the hypothesized realization of the projects 
under review from the consumer point of view. It is extremely 
important since the opinion of the population and of pressure 
groups may heavily influence the amount of time needed to go 
ahead with and complete an energy project. Social acceptance is 
not expressed as a measurable figure. It is not a quantitative 
criteria but a qualitative one. Qualitative measures of alternatives 
against the criteria can be obtained according to the results of the 
survey carried out in the local community or city. Social 
acceptability was employed to analyze their feasibilities of CHP, 
renewable energy power plants, etc. [78,80,81,84]. 


2.1.4.2. Job creation. Energy supply systems employ many people 
during their life cycle, from construction and operation till 
decommissioning. The energy systems are closely related to the 
society shown in Fig. 1. Local societies where energy systems were 
established based their development and prosperity on them for 
many decades. The sustainable energy system creating more jobs 
for people is beneficial to improve the living quality of local 
peoples [80]. In the DM process of local governments, job creations 
of energy systems are indispensably considered and are selected to 
evaluate their contributions [13,36,38,80-82,86,89,90]. 


2.1.4.3. Social benefits. Social benefits were definitely the most 
important criteria for people’s life during the past decades. The 
criteria express the social progress in the local regions by 
introducing an energy project, especially in the less developed 
regions. Social benefit is also a qualitative criteria and not 
expressed as a measurable figure. The criteria is a recapitulative 
criteria, but some actual items can express it, such as job creations, 
social life and income generation [104]. Social benefits were 
directly used to aid in the sustainable energy DM [13,39-42]. 

Furthermore, some researchers have employed some particular 
and recapitulative criteria aid in sustainable energy DM. National 
economy was introduced to evaluate the contributions of the 
energy systems to national economy and social development [40- 
42]. Health social criteria were applied to select the best CHP 
alternative in Croatia because the NO, emission of energy systems 
has a direct impact on the health of the community [78]. Also 
compensation rate aims at restoring people’s degradation of 
quality of life and was used to assess power plants [80]. Energy use 
per household, share of household income spent on fuel and 
electricity, number of injured per energy produced and number of 
working hours per energy produced were used to analyze five 
scenarios of sustainable energy systems in Belgrade [11]. 
Compatibility with political, legislative and administrative frame- 
work was adopted to decide the diffusion of renewable energy 
technology with regard to government support, the tendency of 
institutional actors, and the policy of public information [82]. 
Advanced performance and maintenance convenience were used 
to show their contributions of the energy technologies to social 
development [29,45,76]. 


2.2. Methods of criteria selection 


There are various criteria to show the performance of energy 
system. It is not absolute that more and more criteria are helpful to 
the sustainable energy decision-making. Likewise, less criteria are 
beneficial to the evaluation of energy systems. Furthermore, there 
are repeatability and relevancy in the criteria system, such as the 
inclusion of fuel cost in operation and maintenance cost, and job 
creations and social benefits of energy project. Generally, the 
following principles are obeyed to select the “major” criteria used 
to energy decision-making [105,106]: 


(1) Systemic principle. The criteria system should roundly reflect 
the essential characteristic and the whole performance of the 
energy systems. The comprehensive evaluation function of 
multi-criteria can obtain better results than the sum of single 
criteria evaluations. 

(2) Consistency principle. The criteria system should be consistent 
with the DM objective. 

(3) Independency principle. The criteria should not have inclusion 
relationship at the same level criteria. The criteria should 
reflect the performance of alternatives from different aspects. 

(4) Mensurability principle. The criteria should be measurable in 
quantitative value as possible or qualitatively expressed. 

(5) Comparability principle. The DM result is more rational when 
the comparability of criteria is more obvious. Additionally, the 
criteria should be normalized to compare or operate directly 
when there are both benefit criteria and cost criteria. 


These principles give the instruction to the decision-makers to 
select criteria. However, these principles are difficult to follow and 
some “minor” criteria may be chosen. Therefore it is necessary that 
some rational methods are applied to select the “major” criteria, 
distinguish the main and secondary and construct the reasonable 
criteria systems. The following elementary selection methods of 
criteria used to sustainable energy DM are introduced: 
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2.2.1. Delphi method 

The Delphi method is a systematic and interactive method, 
which relies on a panel of independent experts [105-107]. Delphi 
is based on the principle that forecasts from a structured group of 
experts are more accurate than those from unstructured groups or 
individuals [108]. The carefully selected experts answer ques- 
tionnaires for criteria selection to evaluate energy systems in two 
or more rounds. After each round, the summaries of the experts’ 
selection from the previous round as well as the reasons they 
provided for their judgments are fed back to the experts. Thus, 
participants are encouraged to revise their earlier answers in light 
of the replies of other members of the group. It is believed that 
during this process the range of the selected criteria will decrease 
and the group will converge towards the “correct” criteria. Finally, 
the process is stopped after a pre-defined stop criteria (e.g. number 
of rounds, achievement of consensus, and stability of results). 
Delphi has been widely used in social, ecological and economic 
works. Similarly, Delphi method can also be applied in the 
weighting and evaluation in the latter Sections 3 and 4. 


2.2.2. Least mean square (LMS) method 

The principle of LMS method is that one criteria contributes less 
importance to results and it can be ignored when its performances 
of alternatives are almost same or near although the criteria is vital 
in evaluation [105,107]. To lessen its relativity with other criteria, 
the criteria can be removed. Let 


where x; is the i-th sample of the j-th criteria, i= 1, 2, ..., m, and 
Rj = (1/m) OE, Xij. 

If there exists k to make sęk = miny<jcn{sj} and sg% 0, the k 
criteria that corresponds to Sx can be removed. This method can be 
also used to elicit the selected weights in Section 3 (the m 
alternative in the selected n criteria form to the new group decision 
matrix and then the calculated standard deviation in Eq. (2) again 
is normalized to get the weights). 


2.2.3. Minmax deviation method 
Minmax deviation method is similar to LMS method [105,107]. 
The judgment standard is the deviation values of criteria. The 
maximum deviation of criteria x; can be calculated as 
rj = max {xij — x|} (3) 
Likewise, if there exists k to make rg = miny<j<n{rj} and rk% 0, 
the k criteria that correspond to rę can be removed. Similarly, This 
method can be also used to elicit weights. 


2.2.4. Correlation coefficient method 
Correlation analysis adopts the correlation coefficient to show 
the interaction between criteria. The correlation coefficient 


Table 2 
The reviewed weighting methods for sustainable energy DM. 


between criteria C; and criteria CG can be calculated as 


__ cov(C, Cj) 
= a (4) 


where cov(C,G) is the covariance of C; and G, and ôc, and bc, are the 
standard deviation of C; and G respectively. 

The correlation coefficients between n criteria can form to a 
n x n matrix, Ryn. When rj = 1, criteria C; are completely related to 
criteria C. However, the correlation coefficient includes more or 
less influence because other criteria are not constant. To reflect the 
interaction well, the partial correlation coefficient is considered to 
determine the interaction between criteria and computed as 

_ Ri 
E= eR (5) 
where Rj, Rij and Rj are algebraic complements of elements, ry, Ti 
and rj, in matrix R,,.n. Greater the partial correlation coefficient is, 
more correlative the two criteria. When &j=1, criteria G; is 
completely related to criteria G and one of the two criteria can be 
removed. 

Based on the elementary methods, some specific methods were 
developed and extended to various complex systems, such as grey 
relational method [109,110], analytic hierarchy process (AHP) 
[111,112], clustering method [105], principal component analysis 
[113] and rough set method [110]. The principle of all selection 
methods is to eliminate the relevance between criteria and select 
the independent criteria. Grey relational method and AHP are also 
MCDA methods applied to get the ranking order of energy systems 
alternatives and the detailed introduction can be found in Section 4 
of this article. 


3. Weighting methods 


All factors have their internal impact reclassified to a common 
scale so that it is necessary to determine each criteria’s relative 
impact in the sustainable energy DM problem. Weight is assigned 
to the criteria to indicate its relative importance. Different weights 
influence directly the DM results of energy systems’ alternatives. 
Consequently, it is necessary to obtain the rationality and veracity 
of criteria weights. Three factors are usually considered to obtain 
the weights: the variance degree of criteria, the independency of 
criteria, and the subjective preference of the decision-makers. 

Generally there are two methods: the equal weights and the 
rank-order weights [114]. The methods have been both applied in 
sustainable energy DM shown in Table 2. 


(1) Equal weights method 
The criteria weight in equal weights method is defined as 


wok i=1,2,...,n, (6) 


n 


The method requires minimal knowledge of the decision- 
maker’s priorities and minimal input from decision maker. The 


Categories Weighting methods 


Literatures Total number 


Equal weights - 


Rank-order weights Subjective AHP 
Simos 


Pair-wise comparison 


Priority given to one indicator with others being the same 


Others 
Entropy method 
Additive synthesis 


Objective 
Combination 


[30,35-38,44,54,78,83,91] 10 


[33,41-43,57,79-81] 
[32,82,86] 
[29,39,40,60,74,76,87] 
[30,35-38,54,78] 
[11,13,55,85,89,90] 
[60,76,87] 

[76,79,87] 


WwW I NNUA 
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equal weights method was popularized and applied in many 
decision-making problems since Dawes and Corrigan argued 
that this method often produced the results nearly as good as 
those optimal weighting methods in 1974 [115]. Equal weights 
method is the most popular in sustainable energy DM [30,35- 
38,44,54,78,83,91]. 
(2) Rank-order weighting method 

The equal weights method has also been criticized because 
it ignores the relative importance among criteria. Following 
this argument, the rank-order weighting method was proposed 
and criteria weights are distributed as 


W1 >W2>--- >Wn>O (7) 


where 377, wj = 1. 

The rank-order weighting methods are classified into three 
categories: subjective weighting method, objective weighting 
method and combination weighting method. Criteria weights 
determined by the subjective weighting methods depend only 
on the preference of decision-makers, not on the quantitative 
measured data of energy projects. Contrarily, the objective 
weights are obtained by mathematical methods based on the 
analysis of the initial data. The subjective weighting methods 
explain the evaluation clearly while the objectivity ones are 
relatively weak. Additionally, the judgments of decision- 
makers sometimes absolutely depend on their knowledge or 
information. Thus, the criteria weights’ errors in some extent 
are unavoidable. As we can see, none of the two approaches is 
perfect. It may be suggested that an integrated method could 
be most appropriate for determining the criteria weights. 
Currently, a number of combination or optimal weighting 
methods were proposed and developed. 


The weighting stage in Fig. 2 also displays the process that 
combined three weighting categories. First, the subjective weights 
are determined by experts and the concordance of criteria values is 
checked by the decision-maker. When the concordance index is 
not sufficiently high, more experts are needed to modify the 
subjective weights to get the high concordance. Then, the objective 
weights of criteria are calculated in measured data. Finally, the 
concordance of subjective and objective weights is checked in a 
similar way. If the concordance cannot get satisfied, the combina- 
tion methods are applied to determine the integrated weights of 
criteria. 

Table 3 summarizes the weighting methods in the MCDA DM 
[105,107,116,117]. The basic and representative methods are 
presented in this article and other methods can be found detailedly 
in others referred literatures. 


3.1. Subjective weighting methods 


Subjective weighting methods such as pair-wise comparison 
[29,39,40,60,74,76,87], AHP [33,41-43,57,79-81] and Simos 
[32,82,86], were the most used methods in sustainable energy 
DM. Especially, priority given to one indicator with others being 
the same was employed to protrude the performances in one 
aspect in literatures [30,35-38,54,78]. The following part intro- 
duces briefly several representative subjective weighting methods. 


3.1.1. Simple multi-attribute rating technique (SMART) 

SMART was originally described as the whole process of rating 
alternatives and weighting criteria by Edwards in 1977 [118]. The 
participants are asked to rank the importance of the changes in the 
criteria from the worst criteria levels to the best levels. Then they 
assign 10 points to the least important criteria, and increasing 
number of points (without explicit upper limit) are assigned to the 
other criteria to address their importance relative to the least 


Table 3 
Weighting methods in MCDA DM. 


Categories Weighting methods 


Subjective 
weighting 


Simple multi-attribute 
rating technique (SMART) 
SMARTER 

Swing 

Trade-off 

SIMOS 

Pair-wise comparison 
AHP 

Least-square method 
Eigenvector method 
Delphi method 
Consistent matrix analysis 
PATTERN 


Objective 
weighting 


Least mean square (LMS) 
method 

Minmax deviation method 
Entropy method 

TOPSIS method 

Vertical and horizontal 
method 

Variation coefficient 
Multi-objective 
optimization method 
Multiple correlation 
coefficient 

Principal component 
analysis 


Combination 
weighting 


Multiplication synthesis 
Additive synthesis Optimal weighting based on 
sum of squares 
Optimal weighting based on 
minimum bias 
Optimal weighting based on 


relational coefficient of gradation 


important criteria. The weights are calculated by normalizing the 
sum of the points to one. Edwards and Barron listed the 
shortcomings, stressed that weights should clearly be related to 
the criteria ranges in 1994 [119] and presented an improved 
version, SMARTER. The idea of SMARTER is to use the centroid 
method so that the weight of a criteria ranked to be ith is 


w= aE (8) 


k=i 


3.1.2. SWING 

With the SWING weighting method [114,120], the decision 
maker begins by rank ordering criteria in terms of their associated 
value ranges. First the respondent is asked to select the criteria that 
he would most prefer to change from its worst to its best level and 
to assign 100 points to this most important criteria. Then the 
respondent is continued to choose the criteria change from the 
worst to the best level which he considers to be the second most 
desirable improvement and to assign points less than 100 to that 
criteria change. Proceeding in this fashion, the decision maker 
ranks all criteria and assigns relative importance points to their 
value ranges. Finally the given points are normalized to sum up to 
one to get the criteria weights. The SWING method is an algebraic, 
decomposed, direct procedure. 


3.1.3. SIMOS 

The main innovation in this approach proposed by Simos in 
1990 [121] consists of associating a “playing card” with each 
criteria. The participants are asked to rank these cards (or criteria) 
from the least important to the most important. The rank order of a 
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criteria expresses the importance a single participant wants to 
ascribe to that criteria: the first criteria in the ranking is the least 
important and the last criteria in the ranking is the most important. 
If the two criteria are found to be equally important, these are 
given the same rank position. In order to allow participants to 
express strong preference between criteria, another set of cards 
(white cards) is introduced. The participants are asked to introduce 
white cards between two successive colored cards, while the 
number of white cards is proportional to the difference between 
the importance of the considered criteria. Subsequently, the 
criteria weights are calculated using the rank positions attributed 
in the previous step: the rank positions are simply divided by the 
total sum of the positions of the considered criteria, thus providing 
a vector of weights to be applied to the evaluation criteria, in the 
form of real values summing up to 1. 


3.1.4. Pair-wise comparison 

In the pair-wise comparison method, participants are presented 
a worksheet and are asked to compare the importance of two 
criteria at a time: “Which one of these two criteria is more 
important, and how much more important?” Then the relative 
importance is scored. The scales can be various, for example, a scale 
of O (equal importance) to 3 (absolutely more important) is 
commonly adopted. The results are consolidated by adding up the 
scores obtained by each criteria when preferred to the criteria it is 
compared with. The results are then normalized to a total of 1.0. 
This weighting method provides a framework for comparing each 
criteria against all others, and helps to show the difference in 
importance between criteria. However, it does not allow you to 
check the consistency of participants’ preferences, especially, their 
transitivity. You should therefore examine the results’ matrices for 
each participant to check for major problems. 


3.1.5. AHP 

AHP method builds on the pair-wise comparison model for 
determining the weights for every unique criteria. AHP was 
proposed primarily by Saaty in 1980 [122,123]. The matrix of pair- 
wise comparisons when there are n criteria at a given level can be 
formed as: 


C/C C/C C1/Cn 
C2/Cy 2/02 C2/Cn 

=i) 2 (9) 
Cn/Ci Cn/C2 Cn/Cn 


The relative importance can be scaled in Table 4. Based on the 
matrix, criteria weights can be calculated in some methods, such as 
arithmetic mean method, characteristic root method, and least 
square method [124]. Because individual judgments will never 
agree perfectly, the degree of consistency achieved in the pair-wise 
comparison is measured by a consistency ratio indicating whether 
the comparison made is sound. 


Table 4 
The AHP pair-wise comparison scale [125]. 


3.2. Objective weighting methods 


The objective weighting method elicits the criteria weights 
using the measurement data and information and reflects the 
difference degree. The literatures about objective weighting 
methods applied in sustainable energy DM are seldom in the 
reviewed published papers while the objective weighting methods 
were widely applied to other evaluation systems, such as social 
and ecological systems. Only entropy method was employed to 
elicit the weights [60,76,87] in energy projects. The typical 
objective weighting methods are presented as follows. 


3.2.1, Entropy method 
The entropy shows that how much the criteria reflects the 
information of system and how great the uncertainty of criteria is. 


A vector of x; = (X1;,X2j, ---,Xmj) Characterizes the set X in terms of 
the i-th criteria, defined as follows: 


m 
Neh j=1,2,...,n (10) 
i=1 
Then the entropy measure of j-th criteria contrast intensity is 
e; In (11) 


Finally, the normalized weights can be calculated as 


1—ej 


Poe i i 2 
Sae) (1a) 


Wj 


3.2.2. Technique for order preference by similarity to ideal solution 
(TOPSIS) method 

The principle of TOPSIS [126] is that the selected best 
alternative should have the shortest distance from the positive 
ideal solution in geometrical sense. The weighted distance 
between alternative A; and the ideal solution A’ is defined as 
follows: 


n 
hy = X w3 (xij — x)” (13) 
j=l 


Then the following optimal model is solved and the weights can 
be elicited. 


m m n 
min h; = XOX wi (xij — x9)? 
i=l i=l j=l 
f Ss (14) 
st.X wj =1, wj>0 
JET 


3.2.3. Vertical and horizontal method 
Vertical and horizontal method is also an optimal weighting 
method. The weights can be solved from the optimal mathematic 


Intensity of weight Definition 


Explanation 


Equal importance 

Weak/moderate importance of on over another 
Essential or strong importance 

Very strong or demonstrated importance 
Absolute importance 


ONU =e 


Two criteria contribute equally to objectives 

Experience and judgment slightly favored one criteria over another 

Experience and judgment strongly favor one criteria over another 

A criteria is favored very strongly over another; its dominance demonstrated in practice 
The evidence favoring one criteria over another is of the highest 


possible order of affirmation 


2,4,6,8 Intermediate values between the two 
adjacent scale values 
Reciprocals of above 


non-zero number 


Used to represent compromise between the priorities listed above 


If criteria i has one of the above non-zero numbers assigned to it when compared 
to criteria j, then j has the reciprocal value when compared with criteria I 
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Table 5 
The reviewed MCDA methods for sustainable energy DM. 


Categories MCDA methods Literatures Total number 
Elementary Weighted sum [11,35-38,54,71,73,77,78] 10 
Unique synthesizing criteria AHP [30,33,41-43,49,50,52,57,74,79-81] 13 
Fuzzy set methodology [13,26,29,39,40,55,60,72,84,127] 10 
Grey relational method [45,60,76,87] 4 
Outranking Preference ranking organization method for enrichment evaluation [55,83,86,89,90] 5 
(PROMETHEE) 
Elimination et choice translating reality (ELECTRE) [32,46,47,65,66,75,82,88,90] 9 
Others NAIADE [44,84] 2 
MACBETH [85] 1 
Preference assessment by imprecise ratio statements (PAIRS) [91] 1 
model as: as the selection of CCHP alternatives, the comparisons of renew- 


m 
maxs? = $ (z; — Z)?/m 
n o (15) 
st. Xow =1, wj>0 
ja 


where Z = Ð} Wjxij and Z = (1/m) Xi Zi- 

TOPSIS method and vertical and horizontal method both reflect 
the difference of alternatives’ whole performances as possible, 
while LMS method, minmax deviation method and entropy 
method reflect the criteria relative importance based on the 
difference of alternatives to a criteria. In another word, TOPSIS 
method and vertical and horizontal method base on the integrated 
evaluation values while other methods base on the difference of 


single criteria. 
3.3. Combination weighting methods 


Combination weighting methods were gradually applied to the 
evaluation and comparison of complex systems, including energy 
projects [76,79,87]. The methods have two basic combinations: 
multiplication synthesis and additive synthesis. The principle of 
multiplication synthesis is expressed as 


W1ıjW2j 


W= e 
J n 
jai W1jW2j 


(16) 
where wj, W2; and w, are subjective weight, objective weight and 


combination weight of the jth criteria respectively. 
While the additive synthesis is written as 


wj = kwyj + (1 — k)wzj (17) 


where k is the linear combination coefficient and k>0. 

The combination coefficient can be determined by various 
methods, such as optimization based on sum of squares, minimum 
bias and relational coefficient of gradation. For example, the linear 
combination coefficient was solved in Jaynes maximal entropy 
theory and the optimization method and the criteria weights were 
obtained to be used to select the best CCHP scheme from 
alternatives [76]. 


4. Multi-criteria decision analysis methods 


It is the turn to determine the preference orders of alternative 
after determining the criteria weights so that MCAD methods are 
employed to get the ranking order in Eq. (1). In the referred 
literatures, the listed MCDA methods in Table 5 were mainly 
applied in all kinds of sustainable energy DM problems 
[11,13,29,30,32,33,35-47,49,50,52,54,55,57,60,65,66,71-91], such 


able energy plants and the DM of energy policy. 

Table 6 also summaries all related MCDA methods that are 
divided into three categories: elementary methods, methods in 
unique synthesizing criteria and outranking methods. An overview 
of several typical MCDA methods in energy systems is provided 
here. A more detailed analysis of the theoretical foundations of 
theses methods can be found in [106,107,124,128] and/or other 
references. 


4.1, Elementary methods 


The elementary methods in Table 6 includes ten methods, the 
former three methods are defined as non-preference information 
methods without decision maker, and other methods are multi- 
attribute information methods with decision maker. Conjunctive 
and disjunctive methods belong to screening methods that the 
acceptable alternative must exceed given performance thresholds 
for all criteria. Lexicographic, elimination by aspects and linear 
assignment method are ordinal partiality methods. The latter two 
methods need the criteria preference of decision maker. 


4.1.1. Weighted sum method (WSM) 
WSM is the most commonly used approach in sustainable 
energy systems [11,35-38,54,71,73,77,78]. The score of an 


Table 6 
MCDA methods. 


Categories Weighting methods 


Dominance 

Maximin 

Maximax 

Conjunctive 
Disjunctive 
Lexicographic 
Elimination by aspects 
Linear assignment 
Weighted additive 
Weighted product 


Elementary 


Unique synthesizing criteria Analytical hierarchy process (AHP) 
TOPSIS 

SMART 

Grey relational analysis 

Data envelopment analysis 
Multi-attribute value theory (MAVT) 
Multi-attribute utility theory (MAUT) 
Utility theory additive (UTA) 

Fuzzy weighted sum 

Fuzzy maximum 


Outranking ELECTRE I, IS, Il, Ill, IV, TRI 
PROMETHEE I, II 


ORESTRE 
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alternative is calculated as 


n 
Si = lw jx, i= 1,2,...,m (18) 
Jel 


Then the resulting cardinal scores for each alternative can be 
used to rank, screen, or choose an alternative. The best alternative 
is the one whose score is the maximum. 


4.1.2. Weighted product method (WPM) 

The WPM is similar to WSM. The main difference is that instead 
of addition in the calculation there is multiplication. The score of 
alternative i can be calculated as: 


n 
Si= [[x", i=1,2,...,m (19) 
j=1 


Naturally, the alternative having the maximum score is the best 
scheme. Because of the exponent property, this method requires all 
ratings be greater than 1. For example, when a criteria has 
fractional ratings, all ratings in that criteria are multiplied by 10™ 
to meet this requirement. Alternative scores obtained by the 
weighted product method do not have a numerical upper bound. 
The decision maker may also not find any true meaning in those 
scores. Hence, it may be convenient to compare each alternative 
score with the standard score. If an alternative is compared to the 
ideal alternative for the only comparison purpose, the ratio is given 
by 


Si Mja Xi”! 
s Ij- (xi) i 
where x* is the most favorable performance for criteria j. It is found 


clearly that the preference of alternative i increases when R; 
approaches to 1. 


Ri i=1,2,...,m (20) 


4.2. Unique synthesizing criteria methods 


4.2.1. AHP 

AHP is widely used for practical MCDA method in various 
domains, such as social, economic, agricultural, industrial, 
ecological and biological systems, in addition to energy systems 
[30,33,41-43,49,50,52,57,74,79-81]. It is a descriptive decision 
analysis methodology that calculates ratio-scaled importance of 
alternatives through pair-wise comparison of evaluation criteria 
and alternative. It involves decomposing a complex decision into a 
hierarchy with goal (objective) at the top of the hierarchy, criteria 
and sub-criteria at levels and sub-levels of the hierarchy, and 
decision alternatives at the bottom of the hierarchy. 

AHP is a type of weighted sum method. The weights obtained in 
AHP method are introduced in Section 3.1. After obtaining the 
weights, each performance at the given level is then multiplied 
with its weight and then the weighted performances are summed 
to get the score at a higher level. The procedure is repeated upward 
for each hierarchy, until the top of the hierarchy is reached. The 
overall weights with respect to goal for each decision alternative is 
then obtained. The alternative with the highest score is the best 
alternative. 


4.2.2. TOPSIS 

TOPSIS is used as a weighting method in Section 3. Likewise, it 
can also be seen as a MCDA method. TOPSIS [126] is based on the 
concept that the ideal alternative has the best level for all criteria, 
whereas the negative ideal is the one with all the worst criteria 
values [29]. The principle is simple: the selected best alternative 
should have the shortest distance from the positive ideal solution 
in geometrical sense while it has the longest distance from the 


negative solution. The method assumes that each criteria has a 
monotonically increasing or decreasing utility. This makes it easy 
to locate the ideal and negative ideal solutions. 

The positive distance between alternative A; and the ideal 
solution A* is defined as follows: 


where x? is the jth criteria’s performance of the ideal solution A’. 
The negative distance is similarly calculated as follows: 


(22) 


where xp is the j-th criteria’s performances of the negative ideal 
solution A`. 
Finally, the relative closeness degree of A; and A’ is defined to: 
s7 


ie Mi 
pe (23) 


The best alternative is one that has the maximum closeness 
degree and has the shortest distance to the ideal solution. 


4.2.3. Grey relation method 

Grey relational method is a branch of grey systems theory 
developed in 1980 [129] and has been largely applied to MCDA 
problems in addition to energy systems [45,60,76,87]. The 
principle of grey relation method is similar to TOPSIS. The grey 
relation degree is defined in the method to show the closeness 
between the alternatives. Usually, the ideal solution is defined and 
the alternatives’ relation degree with it are calculated. The grey 
relational coefficient of the jth criteria between alternative A; and 
the ideal solution A* can be calculated as: 


minjmin,|x; — xij| + &maxjmaxj|x* — Xij 


|x} — xij] + &max jmax;|X* — Xij 


(24) 


a(Aj, Aij) = 


where x is the most favorable performance for criteria j, € is the 
distinguishing coefficient, 0 < € <1, min; min; Xj — Xjj| is second- 
ary smallest error of Aj and A , and max; max; Ix} — xijl is secondary 
biggest error. 

Then the grey relational degree is equal to the weighted sum of 
its grey relational coefficients. The alternative with the maximum 
relation degree has shortest distance from the ideal solution while 
it has the longest distance from the worst solution. Thus the best 
alternative is selected according to the grey relation degree. 


4.2.4. MCDA combined fuzzy methodology 

The classic MCAD methods generally assume that all criteria 
and their respective weights are expressed in crisp values and, 
thus, that the rating and the ranking of the alternatives can be 
carried out without any problem. In a real-world decision 
situation, the application of the classic multi-criteria evaluation 
methods may face serious practical constraints from the criteria 
perhaps containing imprecision or vagueness inherent in the 
information. Due to the availability and uncertainty of information 
as well as the vagueness of human feeling and recognition, like 
“equally”, “moderately”, “strongly”, “very strongly”, “extremely” 
and a “significant degree”, it is relatively difficult to provide exact 
numerical values for the criteria, make an exact evaluation and 
convey the feeling and recognition of objects for decision makers. 
Hence most of the selection parameters cannot be given precisely 
and the evaluation data of the alternative suppliers’ suitability for 
various subjective criteria and the weights of the criteria are 
usually expressed in linguistic terms by the decision makers. 
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Furthermore, it is also recognized that human judgment on 
qualitative criteria is always subjective and thus imprecise. 

Fuzzy set theory introduced by Zadeh in 1965 [130] can just 
solve the problem and it play a significant role in this kind of 
decision situation. The combination of MCDA methods and fuzzy 
set theory [131] has been applied in many systems in addition to 
energy systems [13,26,29,39,40,55,60,72,84,127]. 


4.3. The outranking methods 


The foundation of the outranking methods is the construction 
and the exploitation of an outranking relation that is introduced by 
Roy. An outranking relation is a binary relation S defined on the set 
of alternatives A such that for any pair of alternatives (A;,A,) €A x 
A: AjSA, if, given what is known about the preferences of the 
decision maker, the quality of the evaluations of the alternatives 
and the nature of the problem under consideration, there are 
sufficient arguments to state that the alternative A; is at least as 
good as the alternative A; while at the same time no strong reason 
exists to refuse this statement. 

Compared to the other multi-criteria evaluation methods, the 
outranking methods have the characteristic of allowing incompar- 
ability between alternatives. This characteristic is important in 
situations where some alternatives cannot be compared for one or 
another reason. 


4.3.1, Elimination et choice translating reality (ELECTRE) method 

Elimination et choice translating reality (ELECTRE) method was 
proposed by Benayoun, Roy and Sussman in 1966 and it was 
developed and improved by Roy in 1971 [132-135]. Up to now, 
ELECTRE families have included ELECTRE I, II, Il, IV, TRI and some 
improved ELECTRE methods. For most ELECTRE methods, there are 
two main stages. These are the construction of the outranking 
relations and the exploitation of these relations to get the final 
ranking of the alternative. Different ELECTRE methods may be 
different in how they define the outranking relations between 
alternatives and how they apply these relations to get the final 
ranking of the alternatives. 

ELECTRE concentrates the analysis on the dominance relations 
among the alternatives. The basic concept of ELECTRE is how to deal 
with outranking relation by using pair-wise comparisons among 
alternatives under each criteria separately. It is based on the study of 
outranking relations, exploitation notions of concordance. These 
outranking relations are built in such a way that it is possible to 
compare alternatives. It uses concordance, discordance indexes and 
threshold values to analyze the outranking relations among the 
alternatives. The concordance index for a pair of alternatives A; and 
Ax Measures the strength of the hypothesis that alternative A; is at 
least as good as alternative Ag. There are no unique measures of 
concordance. In ELECTRE II, the concordance index C(A;,A;,) for each 
pair of alternatives (A;,A;.) is defined as follows: 


jc 04, Ay) Wi 
C(A;, Ap) = —=S | 25 
( i> k) a wj ( ) 
where Q(A;,Ax) is the set of criteria for which A; is equal of preferred 
to (i.e., at least as good as) Ax, and wj is the weight of the jth criteria. 
The discordance index D(A;,A;,) is defined as follows: 


MAX j< Q’(4,.b)|Xbj — Xa; 


D(A;,b) = mee 
max"!_,|Xpj — Xa,j| 


(26) 


where Xaj and xp; represent the performances of alternative A; and 
Ax in terms of criteria j respectively, Q’(A;,A,) is the set of criteria for 
which A; is worse than Ax, and n is the number of criteria. The 
formula can be only used when the scores for different criteria are 
comparable. 


After computing the concordance and discordance indices for 
each pair of alternatives, the graphs for strong and weak 
relationship can be painted respectively by comparing these 
indices with the threshold values. Then these graphs are employed 
to obtain two complete preorders based on descending and 
ascending distillation chains. Finally, the comparison of the two 
complete preorders is used to elaborate the final ranking order of 
alternatives. 

ELECTRE methods are sometimes unable to identify the 
preferred alternative, and in this case, they produce a core of 
leading alternatives. Such methods have been widely used in 
energy DM [32,46,47,65,66,75,82,88,90]. ELECTRE methods are 
particularly convenient when encountering a few criteria with a 
large number of alternatives in a DM problem. 


4.3.2. Preference ranking organization method for enrichment 
evaluation (PROMETHEE) 

PROMETHEE method developed by Brans [136] has been used 
in energy planning and applications, such as geothermal energy 
project [83,89] renewable energy [86,90] energy exploitation [55]. 
This method uses the outranking principle to rank the alternatives, 
combined with the ease of use and decreased complexity. It is well 
adapted to problems where a finite number of alternatives are to 
be ranked considering several, sometimes-conflicting criteria. The 
principle is the construction and the exploitation of a valued 
outranking relation z. Two complete preorders can be obtained by 
ranking the alternatives according to their incoming flow and their 
outgoing flow. The intersection of these two preorders yields the 
partial preorder of PROMETHEE I where incomparabilities are 
allowed. The ranking of the alternatives according to their net flow 
yields the complete preorder of PROMETHEE II. 

Like to ELECTRE method, it also performs a pair-wise 
comparison of alternatives in order to rank them with respect 
to a number of criteria. However, ELECTRE method only pay 
attention to the preference and ignore the difference level between 
alternatives when determining the ranking order. PROMETHEE 
introduces the preference functions to measure the difference 
between two alternatives for any criteria. Brans have offered six 
generalized criteria functions including usual criteria, quasi 
criteria, criteria with linear preference, level criteria, criteria with 
linear preference and indifference, and Gaussian criteria. 

Multi-criteria preference index for a pair of alternatives A; and 
A, is defined as 


jer Wj Pj (Ai, Ax) 
ja Wj 


where p,(a,b) is the preference functions for alternatives a and b. 
Then the incoming flow is calculated as: 


(Aj, Ax) (27) 


m 

`(A) = So m(Ai,Ax), k= 1,2,...,m (28) 
k=1 

and the outgoing flow is calculated as 
m 

@ (Ai) = Som (A, Ai); k=1,2,...,m (29) 
k=1 


Finally, the net flow is equal to the difference of incoming flow 
and outgoing flow. After obtaining all net flows of alternatives, the 
alternative having maximum net flow is considered as the best. 


5. Aggregation methods 
Usually, the decision maker selects the best alternative based 


on the ranking orders after the calculation in a selected MCDA 
method. However, the creditability of DM is necessarily verified so 
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that the results of the ranking orders are computed by a few MCDA 
methods sometimes. The application of various MCDA methods of 
calculation may yield different results (preference ranking order). 
The question “Which method is most suitable to solve the 
problem?” is most important, but difficult to answer. Therefore, 
the ranking results are necessarily aggregated again and the best 
scheme from the alternatives is selected as displayed in Fig. 2. The 
methods used to aggregate the preference orders are called as 
aggregation methods in this article. In the reviewed papers, there 
are few consideration on about aggregation methods in energy DM 
while the aggregation methods were applied in social and 
economic systems [107]. The aggregation methods can be divided 
into two categories: voting method and mathematical aggregation 
method. The mathematical aggregation methods are classified to 
two sub-categories, “hard aggregation method” and “soft aggrega- 
tion method” based on with or without the decision-makers. 


5.1. Voting methods 


A very general approach to aggregating alternatives’ prefer- 
ences is the voting methods. The winning alternative in voting 
methods depends on which voting rule is used. Generally, Borda 
rule and Copeland rule [137] are the most common voting rules. 


5.1.1. Borda 

Borda rule is to select the option that on average stands highest 
in the voters’ rankings. Firstly, assign points to the m alternatives in 
the individual preferences, namely m — 1 points for the top ranked 
alternative, m — 2 points for the second ranked alternative, down 
to 0 points for the bottom ranked alternative; then add up those 
points over all individuals for every alternative; Finally the more 
points an alternative receives the higher ranked it is in the social 
preference. 


5.1.2. Copeland 

Copeland rule is to select the option (if one exists) that beats 
each other option in exhaustive pair-wise comparison. Firstly, 
calculate the number of alternatives it beats by a majority and the 
number of alternatives it looses against for each alternative; then 
calculate the difference between the two numbers; finally, the 
larger the number the higher ranked is the alternative in the social 
preference. 


5.2. Mathematical aggregation methods 


5.2.1. Hard aggregation methods 

“Hard aggregation methods” mean that the aggregating results 
cannot require the decision-maker and are obtained in mathe- 
matical methods over the ranking orders of alternatives, which 
avoid the preference of decision-makers. The aggregating results 
have strong objectivity and the selected scheme is compelling. The 
basic aggregation method is the average method and the 
developed aggregation methods include vertical and horizontal 
aggregation method, and singular value decomposition aggrega- 
tion method. The principle of vertical and horizontal aggregation 
method is similar to the method in Section 3.2.3 and it is also an 
optimal method based on the ranking orders or the evaluation 
scores of alternatives. The singular value decomposition aggrega- 
tion method has been employed to analyze the feasibility of 
combination weighting method for criteria of CHP [87] and the 
principle applied to aggregation of ranking orders is same. 


5.2.2. Soft aggregation methods 

“Soft aggregation methods” require the decision-maker and the 
final results are obtained through the negotiation of decision- 
makers when there are difference or collision of opinion. The 


method embodies the flexible decision that makes the majority of 
decision-makers satisfied. The “soft aggregation methods” are 
more seldom in practical application. Yi et al. proposed the 
aggregation methods treating the multi-evaluation conclusions 
characterized by disagreement [138] and conflict [139]. 


6. Conclusion 


A review of the published literature on sustainable energy 
decision-making presented here indicates greater applicability of 
MCDA methods in changed socio-economic scenario and leads to 
the following conclusions: 


(1) Multi-attributes considered in the sustainable energy decision- 
making gains increasing popularity. It can be observed that 
efficiency, investment cost, CO emission and job creation are 
the most common criteria in the technical, economic, 
environmental and social attributes respectively. The invest- 
ment cost locates the first place in all evaluation criteria and 
CO2 emission follows closely because of more focuses on 
environment protection. 

(2) Criteria weights influence directly the decision-making results of 
energy projects’ alternatives. Equal criteria weights are still the 
most popular in weighting methods. AHP method in the rank- 
order weighting method is more and more prevalent because of 
its understandability in theory and the simplicity in application. 
The objective and combination weighting methods rise in the 
decision-making gradually. They will be largely applied to 
sustainable energy decision-making because they evaluate the 
relative importance objectively without decision-makers. 

(3) MCDA methods have been widely employed to sustainable 
energy decision-making considering multi-criteria. It is 
observed that AHP is the most popular comprehensive method 
so that the elementary weighted sum method is still basic in 
multi-criteria decision-making problems. Fuzzy set methodol- 
ogy has been increasingly applied to take care of the qualitative 
criteria and the imprecision or vagueness inherent in the 
information. 

(4) The evaluation and calculation in the sustainable energy 
decision-making is usually obtained in a MCDA method. It is 
necessary that a few different styles of MCDA methods are 
applied to get the ranking orders of energy projects’ alternatives 
and the validity in MCDA methods is verified. It is believed that 
the results obtained by the aggregation methods are more 
rational and more aggregation methods will aid in the 
sustainable energy decision-making in the future. 


As long as criteria selection and weights, MCDA methods and 
aggregation methods are appropriate and suitable to the specific 
decision problems, MCDA can become a powerful tool for the 
decision-making of sustainable energy systems. 
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